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© Spatial-filtering unit for performing adaptive edge-enhancement process. 



) © A spatial-filtering includes a first filtering unit (3) 

which performs a smoothing process on image data, 
the smoothing process being a process by which 
tone oscillations formed by tone levels are sup- 
pressed. A second filtering unit (4) performs an 
adaptive edge-enhancement process on the image 
data which has previously undergone the smoothing 
process. The adaptive edge-enhancement process is 



a process by which sharpness of edges is en- 
hanced, the edges being parts having steep tone 
gradients in the image. A manner of the adaptive 
edge-enhancement process depends on edge 
amounts present in the input image data. The edge 
amounts are amounts indicating matters as to how 
steep tone gradients of the tone levels represented 
by the image data are. 
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BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to a spatial-filter- 
ing unit used in an image processing apparatus 
and in particular to a spatial-filtering unit for im- 
proving image quality. 

2. Prior Art 

An original image to be processed through a 
digital duplicator, a facsimile apparatus and so forth 
may be generally classified into three categories of 
images, character images, photograph images, and 
halftone-printed images. These categories of im- 
ages have particular properties so that different 
.manners are required to be used in processing 
these categories of images so as to improve image 
quality in copies obtained from the categories of 
original images. For the above purpose, if one 
original image includes at least two of the above 
three categories of image parts, an image-region 
classification process is first performed so as to 
classify the original image into regions consisting 
of the two categories of image parts. After that, 
processes appropriate to the categories of image 
parts are performed on the classified regions. 

Various methods of such an image-region clas- 
sification process have been proposed in, for ex- 
ample, the following papers: 'High Quality Digital 
Image Processing Method using Moire Suppres- 
sion and Edge-Enhancement Filtering', 1992, Im- 
age-Electronics-Society annual-meeting previous 
paper 40, pages 183-186, FIG.1 (Paper 1); and 
'Image-Region Classification Method for Charac- 
ter/Picture(halftone. photograph) Mixed Image', pro- 
posed by the present applicant, Electronics In- 
formation Communication Society Paper Journal 
VoU75-DI1 No.1, pages 39-47, January 1992 (Pa- 
per 2). 

Problems such as those described below are 
present in the above conventional image-region 
classification methods. That is. characters present 
in a white background in the original image can be 
classified to be character image parts in the image- 
region classification methods and thus are pro- 
cessed in a manner appropriate to character im- 
ages. However, it is technically difficult to classify, 
to be character images, characters present in a 
halftone background (the term 'characters present 
in a halftone background' will be referred to as 'in- 
halftone characters', hereinafter) and characters 
present in a color background. As a result, such 
characters are not classified so that the characters 
are processed in a manner as if the relevant image 
parts were not character images but were mixed- 
category images or a part of a picture image such 



as a halftone image or a photograph image. Thus, 
the characters may not be processed in a manner 
appropriate to character images. 

A processing manner not appropriate to char- 

5 acter images is, lor example, a manner of a 
smoothing process in the above Paper 2. In addi- 
tion to performing such a smoothing process, it is 
also possible to perform an edge-enhancement 
process after performing the smoothing process on 

70 such an image region including character image 
parts for a purpose of improving resolution of an 
image on a finally obtained copy. However, it is 
difficult to make compatible resolution improvement 
and Moire elimination to be achieved in processing 

75 in-halftone character image parts. Moire may ap- 
pear as a result of interference occurring between 
spatial periodicities of a halftone relevant to an 
original halftone-printed image and dither provided 
by an apparatus processing the original image. 

20 Such Moire has to be suppressed from appearing 
. so as to improve image quality in an image of a 
finally obtained copy. 

Therefore, if characters present in a white 
background in an original image are assumed to be 

25 classified, in the image-region classification pro- 
cess, as character images and thus are processed 
appropriately to character images to be reproduced 
as to be high quality images, it is required that 
image parts included in a region having been clas- 

30 sified, in the image-region classification process, as 
to be picture images are filtered so as to: 

(1) improve image quality of in-halftone char- 
acters and characters in a color background; 

(2) suppress Moire from appearing from a hal- 
35 ftone-printed original image; and 

(3) make compatible edge enhancement and 
smooth tone variation for a photograph original 
image. However, almost no attempt has been 
made to improve image quality of in-halftone 

40 characters and characters in a color background 
in the prior art. 

The present applicant disclosed a digital color 
image representing apparatus in Japanese Laid- 
Open Patent Application No.6-131455. The appara- 

45 tus is effective to improve image quality of char- 
acters in a white background, in-halftone characters 
and characters in a color background in a repro- 
duced image and also to effectively suppress Moi- 
re from appearing in the reproduced image. It is 

so assumed that the apparatus does not have means 
for carrying out a image-region classification pro- 
cess such as mentioned above and thus may pro- 
cess characters in a white background without 
these characters previously being classified so as 

55 to distinguish these characters from other kinds of 
images. Thus, in the apparatus, a manner in which 
an original image is filtered for smoothing is con- 
trolled so as to be adapted to characteristics of 



i 



3 



EP 0 645 737 A1 



4 



image parts in each original image. 

Japanese Laid-Open Patent Application No.61- 
157162 discloses an image processing apparatus. 
The apparatus detects edge parts in an original 
image so as to determine that the detected edge 
parts are those of character regions, and performs 
an edge-enhancement process on the character 
regions. The apparatus performs a smoothing pro- 
cess on halftone regions in the original image. If in- 
halftone characters are processed in such a meth- 
od, since an edge amount is large in a periphery of 
each character, that is, since tone gradient is steep 
there, even if the character is present in a halftone 
background and thus the periphery consists of a 
halftone image part, the above edge-part detection 
detects the periphery as to be an edge part. Thus, 
the apparatus enhances the edge amount in the 
periphery although the periphery consists of the 
halftone image part. As a result, since the smooth- 
ing process is thus not performed on the periphery 
consisting of the halftone image part, the halftone 
dots present in the periphery are left without being 
smoothed. Thus, jags resulting from the halftone 
dots are left without being smoothed in the periph- 
ery of the character in a reproduced image and 
degrade image quality of the reproduced image. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide 
a spatial-filtering unit for reproducing in-halftone 
characters of high image quality, characters in a 
color background, halftone-printed images and pho- 
tograph images. 

In order to achieve the above object, a spatial- 
filtering unit according to the present invention in- 
cludes two filters. A first filter performs a smoothing 
process on an original image and after that, a 
second filter performs an edge-enhancement pro- 
cess thereon. A manner of the edge-enhancement 
process is varied so as to be adapted to edge 
amounts of currently processed pixels, the edge 
amounts are degrees as to how steep tone gra- 
dients are. The smoothing process smooths peri- 
odic tone oscillation, having spatial frequency more 
than 100 lines/inch (3.9 line-pairs/mm), present in 
the original image. Thus, Moire is prevented from 
appearing. The adaptive edge-enhancement pro- 
cess makes in-halftone characters and characters 
in a color background be thin and be sharp in their 
outlines. Further, the adaptive edge-enhancement 
process enhances edge of edge parts present in 
the original image if it is a picture image including 
a photograph image. 

It is preferable for the unit to have means for 
performing an image-region classification process 
so as to remove a region of characters in a white 
background from an original image before the first 



and second filters perform the relevant processes 
on the original image. The thus-removed region 
may be processed in a manner appropriate to 
character images in accordance with the prior art. 

5 Thus, outline edges of the characters in the white 
background are effectively enhanced so that the 
sharpness of the characters' outlines is improved. 
Further, the characters in the white background are 
prevented from undergoing the smoothing process. 

w Thus, it is not necessary to make the first filter for 
smoothing be an adaptive smoothing filter but a 
smoothing filter having a fixed function can be 
used as the first filter. A region that remains after 
the region of characters in the white background is 

75 removed from the original image is a picture region 
on which the relevant processes are performed by 
the first and second filters. The picture region may 
include in-halftone characters, characters in a color 
background, halftone-printed images and photo- 

20 graph images. 

As a result, it is possible to appropriately repro- 
duce in-halftone characters, characters in a color 
background, halftone-printed images and photo- 
graph images, high image quality being thus 

25 achieved in the thus-reproduced images if any 
sorts of printing means are used to finally print out 
the images. 

It is preferable that an original image in the 
form of a reflectance-linear signal is used to un- 

30 dergo the smoothing process performed by the 
first filter. After undergoing the smoothing process, 
a resulting image is converted into an image in the 
form of a density-linear signal and then undergoes 
the adaptive edge-enhancement process performed 

35 by the second filter. The reflectance-linear signal is 
advantageous for removing Moire contained in the 
signal due to a property of the signal. Further, the 
density-linear signal is advantageous for enhancing 
edge amounts so as to realize thin characters and 

40 sharp outlines of characters in a reproduced image 
from either in-halftone characters or characters in a 
color background in an original image. 

Such a serial execution of the smoothing pro- 
cess and the adaptive edge-enhancement process 

45 make it easy that means for converting the form of 
an image from the reflectance-linear signal into the 
density-linear signal is inserted between the first 
and second filters. If a smoothing unit and an edge- 
enhancement unit are connected in parallel as 

so shown in FIG.1 of the above Japanese Laid-Open 
Patent Application No.61-157162, a structure 
should be complicated to obtain the above-men- 
tioned advantages due to the signal-form conver- 
sion as a result of modifying the structure shown in 

55 FIG.1. 

It is preferable that the first filter has a property 
to smooth halftone dots present in an original im- 
age. 
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It is preferable that the second filter has an 
edge-calculating filter and an edge-enhancement 
filter. The edge-calculating filter detects positions at 
which edges are present and the edge enhancing 
filter enhances spatial frequencies in a high spatial 
frequency band among spatial frequency compo- 
nents the edges have. The edge calculating filter 
calculates edge amounts of image parts in a given 
image, the edge amounts being degrees as to how 
steep tone gradients are. The edge-calculating filter 
has characteristics to increase calculation results 
for sorts of image parts having characteristics such 
as those of characters present in the given image. 
The edge-enhancement filter appropriately en- 
hances edges depending on the thus-obtained 
edge-amounts. Specifically, the edge-calculating fil- 
ter and the edge-enhancement filter have different 
spatial-frequency response characteristics so that 
the edge-enhancement filter has a high response 
especially for an image part having a high spatial- 
frequency in the given image while the edge-cal- 
culating filter has a high response especially for an 
image part having a low spatial-frequency. The 
high response of the edge-enhancement filter es- 
pecially for an image part having a higher spatial- 
frequency is effective to improve sharpness at out- 
lines of characters in the given image. The high 
response of the edge calculating filter especially for 
an image part having a low spatial-frequency is 
effective to suppress edges of halftone dots 
present in a halftone background of the characters 
from being enhanced. Generally speaking, a spatial 
frequency of characters having an ordinary thick- 
ness is lower than one of halftone dots having a 
ordinary density. The above-mentioned low fre- 
quency corresponds to the spatial frequency of the 
characters. Thus, the halftone background does not 
undergo the edge-enhancement process and only 
the outlines of the characters undergo the edge 
enhancement process. Thus, in-halftone characters 
are effectively processed and thus are reproduced 
ideally. 

With regard to characters in a color back- 
ground, if the color background in an original im- 
age consists of a continuously painted color area or 
the like, the edge-calculating filter outputs no sig- 
nificant edge amounts as a result of calculation for 
the color background since the continuously paint- 
ed color area has generally no significant edge 
amounts. As a result, the edge-enhancement filter 
substantially only enhances edges of character im- 
age parts among image parts constituting char- 
acters in the color background. Thus, characters in 
the color background are also effectively processed 
and thus are reproduced ideally. 

Further, the edge-calculating filter may be a 
filter for calculating edge amounts as a result of 
obtaining a difference between pixels having the 



maximum level and the minimum level, the pixels 
being pixels among pixels consisting of a currently 
processed pixel and pixels surrounding the cur- 
rently processed pixel in a given image. Alter- 

5 natively, the edge-calculating filler is a filter for 
calculating edge amounts as a result of obtaining a 
first derivative of pixel data of a currently pro- 
cessed pixel and pixels surrounding the currently 
processed pixel. 

io Other objects and further features of the 

present invention will become more apparent from 
the following detailed description when read in con- 
junction with the accompanying drawings. 

75 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG.1 shows a block diagram of a spatial-filter- 
ing unit in a first embodiment of the present 
invention; 

20 FIGS.2A, 2B, 20 and 2D illustrate effects of 
smoothing a reflectance-linear signal and a den- 
sity-linear signal, FIG.2B showing tone variation 
obtained through a smoothing process from the 
reflectance-linear signal shown in FIG.2A, 

25 FIG.2D showing tone variation obtained through 
a smoothing process from the density-linear sig- 
nal shown in FIG.2C; 

FIG.3 shows an example of a spatial filter for 
enhancing outline edges of characters, the char- 

30 acters being those present in a white back- 
ground, the spatial filter being applicable to the 
edge-enhancement filter shown in FIG.1; 
FIG.4 illustrates signal conversion characteristics 
for converting a reflectance-linear signal into a 

35 density-linear signal; 

FIG.5 shows a block diagram of a spatial-filter- 
ing unit in a second embodiment of the present 
invention, the unit using a density-linear signal 
for an edge-enhancement process; 

'40 FIGS.6A and 6B illustrate effects of performing 
edge-enhancement process on a reflectance-lin- 
ear signal and a density-linear signal. 
FIG. 7 shows characteristics of a smoothing filter 
shows in FIGS.1 and 5; 

45 FIG.8 shows a first example of an adaptive 
edge-enhancement unit shown in FIGS.1 and 5; 
FIG.9 shows an example of a Laplacian (second- 
derivative operator) applicable to one shown in 
FIG.8; 

50 FIG.1 0 shows a second example of an adaptive 
edge-enhancement unit shown in FIGS.1 and 5; 
and 

FIG.1 1 shows an example of a spatial filter ap- 
plicable to an adaptive the edge-enhancement 
55 unit shown in FIG.1 0. 
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DESCRIPTION OF PREFERRED EMBODIMENTS 

With reference to FIG.1, a spatial-filtering unit 
in a first embodiment of the present invention will 
now be described. The spatial-filtering unit includes 
an image-region classifying unit 1 for classifying a 
given image into image parts of characters and 
image parts of non-characters. The classification 
unit 1 outputs a signal for instructing whether cur- 
rently processed image parts belong to the char- 
acter image parts or the non-character image parts. 
The spatial-filtering unit further includes an edge- 
enhancement unit 2 for enhancing sharpness of 
characters. A process the edge-enhancement unit 
2 performs is a process appropriate to, particularly, 
the character image parts, that is, characters in a 
white background. The spatial-filtering unit further 
includes a smoothing unit 3 for smoothing halftone 
dots so as to prevent Moire from appearing. 
Smoothing halftone dots means removing periodic 
tone oscillations present along a given image due 
to the halftone dots. The spatial-filtering unit further 
includes an adaptive edge-enhancement unit 4 for 
enhancing contractivity of in-halftone characters 
and characters in a color background and enhanc- 
ing sharpness of outline-edges of objects present 
in picture images. Processes the smoothing unit 3 
and the adaptive edge-enhancement unit 4 perform 
are processes appropriate to, particularly, the non- 
character image parts, that is, in-halftone char- 
acters, characters in a color background, halftone- 
printed images and photograph images. The spa- 
tial-filtering unit further includes a selecting unit 5 
for, in accordance with the signal output by the 
image-region classification unit 1 , selecting one of 
signals output by the edge-enhancement unit 2 and 
output by the adaptive edge-enhancement unit 4 
appropriate to currently processed image parts. 

It is assumed that input image data supplied to 
the spatial-filtering unit shown in FIG.1 is 400-dpi, 
8-bit (256-tone), reflectance-linear data. The reflec- 
tance-linear data refers to data linear to light inten- 
sities received as a result of being reflected by an 
original image. Further, it is defined that a value 
255 of the image data refers to data corresponding 
to white in the original image and a value 0 of the 
image data refers to data corresponding to black 
therein. Image data obtained through a scanner 
including a CCD from a halftone-printed original 
image may result in Moire. The Moire occurs as a 
result of interference between halftone periods 
present in the original image and sampling periods 
due to characteristics of ordinary image processing 
processes. Such Moire may greatly degrade image 
quality of the original image. Generally speaking, 
smoothing by filtering is effective to prevent Moire 
from occurring and it is advantageous that reflec- 
tance-linear data is used in the smoothing process. 
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With reference to FIGS.2A, 2B, 2C and 2D t 
generally speaking, signal level variation due to 
halftone tone oscillation is distorted in density-lin- 
ear data shown in FIG.2C, while thai is not dis- 

5 torted in reflectance-linear data shown in FIG.2A. 
Therefore, it is easier to remove the oscillation 
using the reflectance-linear signal in comparison to 
using the density-linear signal. The reflectance- 
linear signal and the density-linear signal have 

70 been obtained from the same original halftone- 
printed image. Generally speaking, the reflectance- 
linear signal is a signal which is at first obtained as 
a result of reading-in the original image through an 
image scanner. The density-linear signal is a signal 

75 which is obtained as a result of converting the thus 
obtained reflectance-linear signal. The density-lin- 
ear signal is used in a process of printing-out the 
corresponding image. Since the above conversion 
is a non-linear conversion, periodic variation of the 

20 signal level due to presence of halftone dots in the 
image is distorted in the conversion. In fact, as 
shown in FIG.2D, tone oscillation is left in the 
density-linear signal even after undergoing the 
smoothing process. The thus-left tone oscillation 

25 may result in not only Moire but also in an unex- 
pected color change. On the other hand, if the 
reflectance-linear data shown in FIG.2A is used, 
data shown in FIG.2B having almost no tone os- 
cillation can be obtained. Therefore, the reflec- 

30 tance-linear signal is used as input image data of 
the spatial-filtering unit shown in FIG.1. 

The image-region classification unit 1 may 
have a structure according to a segmentation meth- 
od for documents containing text/picture disclosed 

35 in the above-mentioned Paper 2. The unit 1 deter- 
mines characters in a white background as to be 
character image parts, and determines each of in- 
halftone characters and characters in a color back- 
ground as to be non-character image parts, that is, 

40 picture image parts. It is assumed that the color 
background of 'the characters in a color back- 
ground' is an area having brightness resulting in a 
rather low reflectance-linear data level. Various 
structures, which basically classify characters in a 

45 white background from a given image, may also be 
used as a structure of the image-region classifica- 
tion unit 1 other than that according to the method 
disclosed in the Paper 2. 

The edge-enhancement unit 2 enhances sharp- 
so ness of characters in a white background and uses, 
for example, a digital spatial filter such as that 
shown in FIG.3. The digital spatial filter shown in 
FIG.3 is the same as that shown in FIG.1 1 of the 
above-mentioned Paper 2. See description regard- 

55 ing FIG.1 1 in the Paper 2 for details of the filter. 
Further, it is possible to provide a table conversion 
process to be performed on given image data 
before making the image data pass through the 

5 
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digital spatial filter. See FIG. 4 for characteristics of 
the table conversion process, the table conversion 
process converting the reflectance-linear signal into 
a density-linear signal. The density-linear signal is 
a signal carrying density-linear data having values 
linear to densities of a relevant image and has a 
value 0 for white in the image and a value 255 for 
black therein. 

With reference to FIG.5, a spatial-filtering unit 
in a second embodiment of the present invention 
will now be described. In the filtering unit shown in 
FIG. 5, each of edge-enhancement process by the 
edge-enhancement unit 2 and adaptive edge-en- 
hancement process (which will be described later) 
by the adaptive edge-enhancement unit 4 is per- 
formed on a density-linear signal. Specifically, table 
conversion units 6 are provided before the edge- 
enhancement unit 2 and also before the adaptive 
edge-enhancement unit 4, respectively, as shown 
in FIG.5. 

A dark zone in an image results in a low level 
in a relevant reflectance-linear signal. However, 
after the reflectance-linear signal is converted into 
a density-linear signal, the low level in the reflec- 
tance-linear signal is a high level in the density- 
linear signal, due to property of the conversion, as 
shown in FIGS.6A and 6B. Thus, at the dark zone 
such as that shown in FIG.4 of a relevant image, 
signal-level variation amounts are increased in the 
density-linear signal in general. As a result, char- 
acters, consisting of ordinarily black areas, are thin 
and sharp in a reproduced image. This advantage 
is especially enhanced if a printing unit connected 
after the spatial-filtering unit shown in FIG.5 for 
printing out a reproduced image has characteris- 
tics, such as those of electrophotography, due to 
which characteristics dots present in an original 
image are spread and thus become continuous 
with one another. 

A serial connection of the smoothing unit 3 and 
the adaptive edge-enhancement unit 4 as shown in 
FIG.5 make it easy that means for converting of the 
form of image signal from a reflectance-linear sig- 
nal into a density-linear signal is inserted between 
the units 3 and 4. Thus, modification from the 
structure shown in FIG.1 to the structure shown in 
FIG.5 as a result of inserting the table conversion 
units 6 is easy to be perlormed. As a result, a 
reflectance-linear signal advantageous tor the 
smoothing process is used for the smoothing pro- 
cess and a density-linear signal advantageous for 
the edge-enhancement process is used for the 
edge-enhancement process as shown in FIG.5. As 
described above, if a smoothing unit and an edge- 
enhancement unit are connected in parallel as 
shown in FIG.1 of the above Japanese Laid-Open 
Patent Application No.61 -157162, a structure 
should be complicated to obtain the above-men- 



tioned advantages due to the signal-form conver- 
sion as a result of modifying the structure shown in 
FIG.1. In fact, in the parallel block arrangement 
shown in FIG.1 of the Application No.61-1 57162, 

5 two table conversion units are necessary, one for 
converting a reflectance-linear signal into a density- 
linear signal before an edge enhancer b and an- 
other for converting a density-linear signal into a 
reflectance-linear signal after the edge enhancer b, 

io for example. 

The smoothing unit 3 shown in FIGS.1 and 5 
performs the smoothing process on an image read- 
in through a scanner. The smoothing unit 3 in- 
cludes a smoothing filter having a cut-off spatial 

75 frequency around 100 lines per inch and thus gen- 
erally removes halftone tone-oscillations having 
spatial frequencies more than 100 lines per inch 
(3.9 line-pairs per millimeter) and leaving those as 
they are having spatial frequencies less than the 

20 cut-off frequency. See FIG.7 for characteristics of 
the smoothing filter. As a result of making a signal 
carrying data of an original image pass through the 
smoothing filter, Moire due to the halftone tone- 
oscillations present in the original image is pre- 

25 vented from occurring. Further, the smoothing unit 
3 having the above characteristics also removes 
noise present in photograph original images. 

The adaptive edge-enhancement unit 4 shown 
in FIGS.1 and 5 enhances contractivity of in-hal- 

30 ftone characters and characters in a color back- 
ground and enhances sharpness of outline-edges 
of objects present in picture images including hal- 
ftone-printed images and photograph images, 
sharpness of the images being thus enhanced. 

35 Other regions, that is, regions including no signifi- 
cant edge amounts, in a given image, are left 
without undergoing a significant edge-enhancement 
process. Thus, a reproduced image can be ob- 
tained such that smooth expressions are obtained 

40 from the image at regions corresponding to the 
above other regions. 

With reference to FIG.8, a first example of a 
structure applicable to the adaptive edge-enhance- 
ment unit 4 will be described. An edge-amount 

45 calculating filter (Max-Min) 11 in the structure cal- 
culates edge amounts such as those described 
above in a given image and includes, for example, 
a 3x3 mask. The 3x3 mask calculates a level 
difference between the maximum level and the 

so minimum level among levels of relevant 3x3 pixels 
consisting of a currently processed pixel at the 
center thereof and pixels surrounding the currently 
processed pixel. Thus, an edge amount of the 
currently processed pixel and pixels surrounding 

55 the currently processed pixel is obtained. The thus 
obtained level difference is divided by a predeter- 
mined constant so that a level difference is normal- 
ized into a level variable in a range between 0 and 
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1. Thus, the edge-amount calculating filter 11 out- 
puts a value variable in the 0-1 range for the 
currently processed pixel. 

With reference to FIG.9, a- Laplacian 12 shown 
in FIG.8, a digital spatial filter, acting as an edge- 
enhancement filter, will now be described. This 
filter is the same as the filter disclosed in FIG.27 
(1) of 'Fineness Processing Technology', written by 
Jou Suzuki, pages 107-139 of a publication 'Color 
Hardcopy Image Processing Technology', Triceps 
WS 114, published by Ken Kawauchi, Triceps, Inc., 
on May 25. 1990, printed by Showa Printing Com- 
pany. See description regarding the FIG.27 (1) in 
the publication for detail of the filter. The filter 
multiplies a level of a currently processed pixel by 
4 and obtains a difference between the thus 4- 
times multiplied level and total of levels of 4 pixels 
adjacent leftward, rightward, upward and downward 
to the currently-processed pixel. By the above cal- 
culating process, a change rate of tone gradient 
along each of a main-scan direction and a sub- 
scan direction is obtained. Specifically, if there is 
no tone gradient, that is, tone is uniform over an 
image part, no significant value is output by the 
Laplacian 12. If a tone gradient is uniform over an 
image part including the above-mentioned five pix- 
els, that is. for example, if the image part is posi- 
tioned midway of an edge, also no significant value 
is output by the Laplacian 12. If a tone gradient is 
varying in an image part, that is, if an edge is 
beginning in the image part or if an edge is finish- 
ing in the image part, a significant value is output 
by the Laplacian. In such a case, a negative value 
is output for an edge-beginning point and a positive 
value is output for an edge-finishing point. 

Thus, an edge-enhancing coefficient is pro- 
duced for an edge consisting of the currently pro- 
cessed pixel and the other 4 pixels. The enhance- 
ment of the edge is, in the specification and claims 
of the present application, referred to as an opera- 
tion to control levels of relevant pixels so that 
sharpness of -the edge is enhanced. For this pur- 
pose, a tone difference between inside and outside 
of an edge is increased at an image part located in 
close proximity to the edge. In fact, as a result of 
the above-mentioned operations performed by the 
Laplacian, image data input to the adaptive edge- 
enhancement unit .4 having the structure shown in 
FIG.8 is modified so that a tone level is made 
locally lowered at the edge beginning point and a 
tone level is made locally raised at the edge finish- 
ing point. The structure of the Laplacian 12 is not 
limited to that shown in FIG.9 and various struc- 
tures performing similar functions may be applied 
to the Laplacian 12. 

A multiplying device 13, shown in FIG.8 mul- 
tiplies outputs of the Laplacian and the above- 
described edge-amount calculating filter (Max-Min) 



11 with one another. Thus, an edge-enhancement 
coefficient produced by the Laplacian 12 is con- 
trolled due to the edge amount around the cur- 
rently-processed pixel. An adding device 14 adds a 
5 signal output by the multiplying device 13 with a 
signal smoothed by the smoothing unit 3 and input 
to the adaptive edge-enhancement unit 4 having 
the structure shown in FIG.8. Thus, the edge con- 
sisting of the currently-processed pixel and adja- 

w cent and surrounding pixels is effectively enhanced 
using the edge-enhancement coefficient controlled 
by the calculated edge amount. If the adaptive 
edge-enhancement unit 4 shown in FIG.5 has the 
structure shown in FIG.8, the signal input to the 

75 adding device 14, the Laplacian 12 and the edge- 
amount calculating filter 1 1 is a signal output by 
the table conversion unit 6. 

The above-described Laplacian 12 and edge- 
amount calculating filter (Max-Min) 11 have char- 

20 acteristics such that each of a value output by the 
Laplacian 12 and a value output by the edge- 
amount calculation filter 11 varies as a spatial fre- 
quency of an image part around the currently pro- 
cessed pixel, as follows: The Laplacian 12 has a 

25 large output value especially for an image part 
having a high spatial-frequency in a frequency 
range while the edge-amount calculating filter 11 
has a large output value especially for an image 
part having a low spatial-frequency lower than the 

30 above frequency range. The above frequency 
range is one between 6-8 line-pairs per millimeter, 
that is, 150-200 lines per inch. Having a large 
output value of the Laplacian 12 for an image part 
having such a high spatial-frequency is effective to 

35 increase sharpness of outlines of characters. 

Having a large output value of the edge- 
amount calculating filter 11 especially for an image 
part having such a low spatial-frequency is effec- 
tive to suppress edges of halftone dots present in a 

40 halftone background of the characters from being 
enhanced. In fact, generally speaking, a spatial 
frequency of characters having an ordinary thick- 
ness is lower than one of halftone dots having an 
ordinary density. The above-mentioned low fre- 

45 quency generally corresponds to the spatial fre- 
quency of the characters. Thus, for image parts 
corresponding to the characters, an output value of 
the edge-amount calculating filter 1 1 is relatively 
high and thus the edge-enhancement coefficient is 

so increased. As a result, sharpness of the characters 
are effectively improved. On the other hand, for an 
image part included in the halftone background, an 
output value of the edge-amount calculating filter 
1 1 is relatively low and thus the edge-enhancement 

55 coefficient is reduced. As a result, enhancement of 
the edges present in the halftone background, that 
is, enhancement of the edges of halftone dots is 
effectively suppressed. 

7 
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The generating of the edge-enhancement co- 
efficients by the Laplacian 12 has characteristics 
such that the Laplacian has significant output val- 
ues for the range of all possible spatial frequencies 
(0-10 line-pairs per millimeter) for image parts hav- 
ing edges therein. Thus, it is possible to obtain 
high image quality for in-halftone characters. In 
particular, an edge-enhancement operation such 
that edges having high spatial frequencies are en- 
hanced is effective to improve sharpness of char- 
acters. Thus, it is preferable that the Laplacian has 
characteristics so as to achieve the above-men- 
tioned edge-enhancement operation. Fine adjust- 
ment of a coefficient of the edge amounts cal- 
culated by the edge-amount calculating filter 11, 
that is, how large of coefficients of the calculated 
edge amounts should be used to directly control 
the edge-enhancement coefficients produced by 
the Laplacian, is possible by the following way: 
Appropriate table-converting means is inserted at a 
position between the calculating filter 11 and mul- 
tiplying device 13, pointed out by a symbol 'a* 
shown in FIG. 8. The table-converting means con- 
verts, one by one, values output by the calculating 
filter 1 1 in accordance with a conversion table. 

Thus, by each of the spatial-filtering units 
shown in FIGS.1 and 5, tone oscillations due to 
halftone dots present in a halftone-printed image 
part are smoothed. On-halftone characters are pro- 
cessed so that tone oscillations due to halftone 
dots present in a halftone background of the in- 
halftone characters are smoothed. Further, edges 
of the halftone dots are not treated as edges to be 
enhanced and edges of characters even present in 
the halftone background are enhanced. As a result, 
a reproduced image can be obtained, in which 
sharpness of image parts which is desired is en- 
hanced and undesired tone oscillations present in 
image parts are removed. 

With reference to FIG. 10, a second example of 
a structure applicable to the adaptive edge-en- 
hancement unit shown in FIGS.1 and 5 will now be 
described. The structure shown in FIG. 10 is the 
same as that shown in FIG.8, except for another 
edge-amount calculating filter 15 provided instead 
of the edge-amount calculating filter 11 used in the 
structure shown in FIG. 8. With reference to FIG.11, 
a specific example of the edge-amount calculating 
filter 15 will now be described. The edge-amount 
filter shown in FIG. 11 performs a first-derivative 
filtering process on tone levels of a pixel set con- 
sisting of a currently processed pixel and pixels 
surrounding the currently processed pixel. That is, 
the filter shown in FIG.1 1 obtains an absolute value 
of a first derivative of an input image data I, indicat- 
ing the tone levels of the above-mentioned pixel 
set, so as to obtain a tone gradient along a main- 
scan direction and obtains an absolute value of a 



first derivative of the input image data I so as to 
obtain a tone gradient along a sub-scan direction. 
The filter then obtains, as to be an edge amount, 
the maximum value of. the thus-oblained absolute 

5 values, that is, the maximum value of absolute 
values of tone gradients along the two directions. A 
function f(x) shown in FIG.1 1 is a function to nor- 
. malize the thus-obtained edge amount into a value, 
the possible maximum value of which is 1. For 

w further detail of the expression shown in FIG.11, 
see an equation 1 and description regarding the 
equation disclosed in the above-mentioned Japa- 
nese Laid-Open Patent Application No.61-157162. 
Characteristics of the Laplacian 12 and edge- 

15 amount calculating filter 15 depending on spatial 
frequencies of relevant image parts are similar to 
those of the Laplacian 12 and edge-amount cal- 
culating filter 1 1 described for the structure shown 
in FIG.8. That is, the Laplacian 12 has a large 

20 output value especially for an image part having a 
high spatial-frequency in the frequency range while 
the edge-amount calculating filter 15 has a large 
output value especially for an image part having a 
low spatial-frequency lower than the above fre- 

25 quency range. The structure of the edge-amount 
calculating filter 15 is not limited to that shown in 
FIG.11 and various structures performing similar 
functions may be applied to the edge-amount cal- 
culating filter 15. 

30 Further, the present invention is not limited to 

the above-described embodiments, and variations 
and modifications may be made without departing 
from the scope of the present invention. 

35 Claims 

1. A spatial-filtering unit for spatial-filtering image 
data, 

the image data representing tone levels of 
40 an image; 

characterized in that: 

said spatial-filtering unit comprising: 

first filtering means (3) for performing a 
smoothing process on the image data; 
45 said smoothing process being a process 

by which tone oscillations formed by the tone 
levels are suppressed; and 

second filtering means (4) for performing 
an adaptive edge-enhancement process on the 
so image data which has previously undergone 

said smoothing process; 

said adaptive edge-enhancement process 
being a process by which sharpness of edges 
is enhanced, the edges being parts having 
55 steep tone gradients in the image; 

a manner of said adaptive edge-enhance- 
ment process depending on edge amounts 
present in the input image data; and 
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the edge amounts being amounts indicat- 
ing matters as to how steep tone gradients of 
tone levels represented, by said image data is. 

2. The spatial-filtering unit according to claim 1 , 

characterized in that: 

said spatial-filtering unit further comprises 
image-region classification means (1) for clas- 
sifying the image into character regions and 
other regions; 

the character regions being regions com- 
prising characters in a white background; 

said smoothing process and said adaptive 
edge-enhancement process being performed 
on said other regions. 

3. The spatial-filtering unit according to claim 1, 

characterized in that; 

said first filtering means (3) performs said 
smoothing process on the image data in the 
form of a reflectance-linear signal; 

the reflectance-linear signal representing 
tone levels linear to reflectance of light re- 
flected by an original image; 

said spatial-filtering unit further comprises 
data-form converting means (6) for converting 
the form of the image data from the form of 
the reflectance-linear signal into the form of a 
density-linear signal before said second filter- 
ing means performs said adaptive edge-en- 
hancement process on the image data; and 

the density-linear signal representing tone 
levels linear to densities of the original image. 

4. The Spatial-filtering unit according to claim 1, 

characterized in that: 

said first filtering means (3) removes tone 
oscillations due to halftone dots present in the 
image; 

said second filtering means (4) enhances 
edges other than edges due to the halftone 
dots. 

5. The spatial-filtering unit according to claim 1, 

characterized in that: 

said second filtering means (4) comprises: 
edge-detecting means (11 or 15) for de- 
tecting edges and boundaries of characters 
present in the image; and 

edge-enhancement means (12) for enhanc- 
ing the edges detected by said edge-detecting 
means. 

6. The spatial-filtering unit according to claim 5, 

characterized in that: 

said edge-detecting means (11 or 15) 
comprises a spatial-frequency band-pass filter 
for detecting edges of the image having spatial 



frequencies corresponding to those of ordinary 
characters. 

7. The spatial-filtering unit according to claim 5, 
5 characterized in that: 

said edge-enhancing means (12) enhances 
high spatial frequencies edges have. 

8. The spatial-filtering unit according to claim 1 , 
10 characterized in that: 

said second filtering means (4) comprises: 

an edge-amount calculating filter (11 or 
15) for calculating the edgo amounts; and 

an edge-enhancement filter (12) for en- 
75 hancing the edges in a manner depending on 

the edge amounts calculated by said edge- 
amount calculating filter; 

said edge-amount calculating filter (11 or 
15) having large output values especially for 
20 image parts of the image having relatively low 

spatial frequencies, while said edge-enhance- 
ment filter (12) has large output values espe- 
cially for image parts of the image having high 
spatial frequencies higher than said relatively 
25 low spatial frequencies. 

9. The spatial-filtering unit according to claim 8, 

characterized in that: 

said edge-amount calculating filter (11) ob- 
30 tains each of the edge amounts as a result of 

obtaining a difference between the maximum 
tone level and the minimum tone level of tone 
levels of a relevant image part of the image. 

35 10. The spatial-filtering unit according to claim 8, 
characterized in that: 

said edge-amount calculating filter (15) ob- 
tains a first derivative of the image data so as 
to obtain the edge amounts. 

40 

11. The spatial-filtering unit according to claim 8, 

characterized in that: 

said edge-enhancement filter (12) com- 
prises a Laplacian for obtaining a second de- 
45 rivative of the image data. 

12. The spatial-filtering unit according to claim 8, 

characterized in that: 

said spatial-filtering unit further comprises 
so fine-adjustment means for fine adjustment of 

coefficient of the edge amounts to be taken 
into account of by said edge-enhancement fil- 
ter (12). 

55 
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